Fangyin Wei

fangyinw (at) nvidia (dot) com

I am a research scientist in the Deep Imagination Research Group at NVIDIA. My research lies at the intersection of computer vision, computer graphics, and machine learning. I am currently interested in combining generative AI and physical simulation. Previously, I was more focused on 3D modeling, synthesis, and editing through the lens of machine learning.

I received my Ph.D. at Princeton University, where I was co-advised by Szymon Rusinkiewicz and Thomas Funkhouser. Prior to joining Princeton, I got my Bachelor's in Computer Science and Economy from Peking University. I was a research intern at Meta Reality Labs, Uber ATG R&D, Google Research, Microsoft Research Asia, and Stanford University.

/ /


News / Invited Talks



Publications

Cosmos World Foundation Model Platform for Physical AI

NVIDIA: Niket Agarwal, Arslan Ali, Maciej Bala, Yogesh Balaji, Erik Barker, Tiffany Cai, Prithvijit Chattopadhyay, Yongxin Chen, Yin Cui, Yifan Ding, Daniel Dworakowski, Jiaojiao Fan, Michele Fenzi, Francesco Ferroni, Sanja Fidler, Dieter Fox, Songwei Ge, Yunhao Ge, Jinwei Gu, Siddharth Gururani, Ethan He, Jiahui Huang, Jacob Huffman, Pooya Jannaty, Jingyi Jin, Seung Wook Kim, Gergely Klár, Grace Lam, Shiyi Lan, Laura Leal-Taixe, Anqi Li, Zhaoshuo Li, Chen-Hsuan Lin, Tsung-Yi Lin, Huan Ling, Ming-Yu Liu, Xian Liu, Alice Luo, Qianli Ma, Hanzi Mao, Kaichun Mo, Arsalan Mousavian, Seungjun Nah, Sriharsha Niverty, David Page, Despoina Paschalidou, Zeeshan Patel, Lindsey Pavao, Morteza Ramezanali, Fitsum Reda, Xiaowei Ren, Vasanth Rao Naik Sabavat, Ed Schmerling, Stella Shi, Bartosz Stefaniak, Shitao Tang, Lyne Tchapmi, Przemek Tredak, Wei-Cheng Tseng, Jibin Varghese, Hao Wang, Haoxiang Wang, Heng Wang, Ting-Chun Wang, Fangyin Wei, Xinyue Wei, Jay Zhangjie Wu, Jiashu Xu, Wei Yang, Lin Yen-Chen, Xiaohui Zeng, Yu Zeng, Jing Zhang, Qinsheng Zhang, Yuxuan Zhang, Qingqing Zhao, Artur Zolkowski
arXiv, 2025  

Edify 3D: Scalable High-Quality 3D Asset Generation

NVIDIA: Maciej Bala, Yin Cui, Yifan Ding, Yunhao Ge, Zekun Hao, Jon Hasselgren, Jacob Huffman, Jingyi Jin, J.P. Lewis, Zhaoshuo Li, Chen-Hsuan Lin, Yen-Chen Lin, Tsung-Yi Lin, Ming-Yu Liu, Alice Luo, Qianli Ma, Jacob Munkberg, Stella Shi, Fangyin Wei, Donglai Xiang, Jiashu Xu, Xiaohui Zeng, Qinsheng Zhang
arXiv, 2024  
paper / webpage / demo API / video / bibtex
@article{nvidia2024edify3d,
  title={Edify 3D: Scalable High-Quality 3D Asset Generation},
  author={NVIDIA and Bala, Maciej and Cui, Yin and Ding, Yifan and Ge, Yunhao and Hao, Zekun and Hasselgren, Jon and Huffman, Jacob and Jin, Jingyi and Lewis, J.P. and Li, Zhaoshuo and Lin, Chen-Hsuan and Lin, Yen-Chen and Lin, Tsung-Yi and Liu, Ming-Yu and Luo, Alice and Ma, Qianli and Munkberg, Jacob and Shi, Stella and Wei, Fangyin and Xiang, Donglai and Xu, Jiashu and Zeng, Xiaohui and Zhang, Qinsheng},
  journal={arXiv preprint arXiv:2411.07135},
  year={2024}
}
            

Edify Image: High-Quality Image Generation with Pixel Space Laplacian Diffusion Models

NVIDIA: Yuval Atzmon, Maciej Bala, Yogesh Balaji, Tiffany Cai, Yin Cui, Jiaojiao Fan, Yunhao Ge, Siddharth Gururani, Jacob Huffman, Ronald Isaac, Pooya Jannaty, Tero Karras, Grace Lam, J. P. Lewis, Aaron Licata, Yen-Chen Lin, Ming-Yu Liu, Qianli Ma, Arun Mallya, Ashlee Martino-Tarr, Doug Mendez, Seungjun Nah, Chris Pruett, Fitsum Reda, Jiaming Song, Ting-Chun Wang, Fangyin Wei, Xiaohui Zeng, Yu Zeng, Qinsheng Zhang
arXiv, 2024  
paper / webpage / demo API / video / bibtex
@article{nvidia2024edifyimage,
    title     = {Edify Image: High-Quality Image Generation with Pixel Space Laplacian Diffusion Models},
    author    = {NVIDIA and Yuval Atzmon and Maciej Bala and Yogesh Balaji and Tiffany Cai and Yin Cui and Jiaojiao Fan and Yunhao Ge and Siddharth Gururani and Jacob Huffman and Ronald Isaac and Pooya Jannaty and Tero Karras and Grace Lam and J. P. Lewis and Aaron Licata and Yen-Chen Lin and Ming-Yu Liu and Qianli Ma and Arun Mallya and Ashlee Martino-Tarr and Doug Mendez and Seungjun Nah and Chris Pruett and Fitsum Reda and Jiaming Song and Ting-Chun Wang and Fangyin Wei and Xiaohui Zeng and Yu Zeng and Qinsheng Zhang},
    journal   = {arXiv preprint arXiv:2411.07126},
    year      = {2024},
    url       = {https://arxiv.org/abs/2411.07126}
}
            

4d-rotor gaussian splatting

VCR-GauS: View Consistent Depth-Normal Regularizer for Gaussian Surface Reconstruction

Hanlin Chen, Fangyin Wei, Chen Li, Tianxin Huang, Yunsong Wang, Gim Hee Lee
Conference on Neural Information Processing Systems (NeurIPS), 2024  
paper / webpage / code / bibtex
@inproceedings{chen:2024:vcrgaus,
   author = "Hanlin Chen and Fangyin Wei and Chen Li and Tianxing Huang and Yunsong Wang and Gim Hee Lee",
   title = "VCR-GauS: View Consistent Depth-Normal Regularizer for Gaussian Surface Reconstruction",
   booktitle = "Advances in Neural Information Processing Systems",
   year = "2024"
}
            

4d-rotor gaussian splatting

4D-Rotor Gaussian Splatting: Towards Efficient Novel-View Synthesis for Dynamic Scenes

Yuanxing Duan*, Fangyin Wei*, Qiyu Dai, Yuhang He, Wenzheng Chen, Baoquan Chen
Proc. SIGGRAPH, 2024  
paper / webpage / code / bibtex
@inproceedings{duan:2024:4drotorgs,
   author = "Yuanxing Duan and Fangyin Wei and Qiyu Dai and Yuhang He and Wenzheng Chen and Baoquan Chen",
   title = "4D-Rotor Gaussian Splatting: Towards Efficient Novel-View Synthesis for Dynamic Scenes",
   booktitle = "Proc. SIGGRAPH",
   year = "2024",
   month = July
}
            

clutter removal

Clutter Detection and Removal in 3D Scenes with View-Consistent Inpainting

Fangyin Wei, Thomas Funkhouser, Szymon Rusinkiewicz
International Conference on Computer Vision (ICCV), 2023  
paper (full) / webpage / bibtex
@inproceedings{Wei:2023:CDA,
   author = "Fangyin Wei and Thomas Funkhouser and Szymon Rusinkiewicz",
   title = "Clutter Detection and Removal in {3D} Scenes with View-Consistent Inpainting",
   booktitle = "International Conference on Computer Vision (ICCV)",
   year = "2023",
   month = oct
}
            

Uni-3D

Uni-3D: A Universal Model for Panoptic 3D Scene Reconstruction

Xiang Zhang*, Zeyuan Chen*, Fangyin Wei, Zhuowen Tu
International Conference on Computer Vision (ICCV), 2023  
paper / code / bibtex
@InProceedings{Zhang_2023_ICCV,
    author    = {Zhang, Xiang and Chen, Zeyuan and Wei, Fangyin and Tu, Zhuowen},
    title     = {Uni-3D: A Universal Model for Panoptic 3D Scene Reconstruction},
    booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
    month     = {October},
    year      = {2023},
    pages     = {9256-9266}
}
            

articulated object

Self-supervised Neural Articulated Shape and Appearance Models

Fangyin Wei, Rohan Chabra, Lingni Ma, Christoph Lassner, Michael Zollhöfer,
Szymon Rusinkiewicz, Chris Sweeney, Richard Newcombe, Mira Slavcheva
Computer Vision and Pattern Recognition (CVPR), 2022  
paper (full) / webpage / bibtex
@inproceedings{wei2022nasam,
    title = {Self-supervised Neural Articulated Shape and Appearance Models},
    author = {Fangyin Wei and Rohan Chabra and Lingni Ma and Christoph
              Lassner and Michael Zollhoefer and Szymon Rusinkiewicz and Chris
              Sweeney and Richard Newcombe and Mira Slavcheva},
    booktitle = {Proceedings IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
    year={2022}
}
            

semantic edit

Learning to Infer Semantic Parameters for 3D Shape Editing

Fangyin Wei, Elena Sizikova, Avneesh Sud, Szymon Rusinkiewicz, Thomas Funkhouser
International Conference on 3D Vision (3DV), 2020  
paper / supplement / arXiv (full) / bibtex
@inproceedings{Wei:2020:LTI,
   author = "Fangyin Wei and Elena Sizikova and Avneesh Sud and Szymon Rusinkiewicz
      and Thomas Funkhouser",
   title = "Learning to Infer Semantic Parameters for {3D} Shape Editing",
   booktitle = "International Conference on 3D Vision (3DV)",
   year = "2020",
   month = nov
}
            

NLOS Imaging

Learned Feature Embeddings for Non-Line-of-Sight Imaging and Recognition

Wenzheng Chen*, Fangyin Wei*, Kyros Kutulakos, Szymon Rusinkiewicz, Felix Heide
ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 2020  
paper / supplement / webpage / code / bibtex
@article{Chen:NLOS:2020,
title = {Learned Feature Embeddings for Non-Line-of-Sight Imaging and Recognition},
author = {Wenzheng Chen and Fangyin Wei and Kiriakos N. Kutulakos and Szymon Rusinkiewicz and Felix Heide},
year = {2020},
issue_date = {December 2020}, 
publisher = {Association for Computing Machinery}, 
volume = {39}, 
number = {6}, 
journal = {ACM Transactions on Graphics (Proc. SIGGRAPH Asia)}, 
}
            

NLOS Detection and Tracking

Seeing Around Street Corners: Non-Line-of-Sight Detection and Tracking In-the-Wild Using Doppler Radar

Nicolas Scheiner*, Florian Kraus*, Fangyin Wei*, Buu Phan, Fahim Mannan, Nils Appenrodt, Werner Ritter, Jürgen Dickmann, Klaus Dietmayer, Bernhard Sick, Felix Heide
Computer Vision and Pattern Recognition (CVPR), 2020  
paper / webpage / code / bibtex
@InProceedings{scheiner2019seeing,
author={Scheiner, Nicolas and Kraus, Florian and Wei, Fangyin and Phan, Buu and Mannan, Fahim and Appenrodt, Nils and Ritter, Werner and Dickmann, J{\"u}rgen and Dietmayer, Klaus and Sick, Bernhard and Heide, Felix},
title={Seeing Around Street Corners: Non-Line-of-Sight Detection and Tracking In-the-Wild Using Doppler Radar},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2020}
}
            

RSA

ADA-Tucker: Compressing deep neural networks via adaptive dimension adjustment tucker decomposition

Zhisheng Zhong, Fangyin Wei, Zhouchen Lin, Chao Zhang
Neural Networks 110: 104-115, 2019  
paper / bibtex
@article{DBLP:journals/nn/ZhongWLZ19,
  author    = {Zhisheng Zhong and
               Fangyin Wei and
               Zhouchen Lin and
               Chao Zhang},
  title     = {ADA-Tucker: Compressing deep neural networks via adaptive dimension
               adjustment tucker decomposition},
  journal   = {Neural Networks},
  volume    = {110},
  pages     = {104--115},
  year      = {2019},
  url       = {https://doi.org/10.1016/j.neunet.2018.10.016},
}
            

integral regression

Integral Human Pose Regression

Xiao Sun, Bin Xiao, Fangyin Wei, Shuang Liang, Yichen Wei
European Conference of Computer Vision (ECCV), 2018  
paper / code / bibtex
@InProceedings{sun2017integral,
  author    = {Xiao Sun and
               Bin Xiao and
	       Fangyin Wei and
               Shuang Liang and
               Yichen Wei},
  title     = {Integral Human Pose Regression},
  booktitle = {ECCV},
  year      = {2018}
  }
            

D^2AE

Exploring Disentangled Feature Representation Beyond Face Identification

Yu Liu*, Fangyin Wei*, Jing Shao*, Lu Sheng, Junjie Yan, Xiaogang Wang
Computer Vision and Pattern Recognition (CVPR), 2018  
paper/ webpage / poster / bibtex
@InProceedings{liu2018exploring,
  title={Exploring Disentangled Feature Representation Beyond Face Identification},
  author={Liu, Yu and Wei, Fangyin and Shao, Jing and Sheng, Lu and Yan, Junjie and Wang, Xiaogang},
  booktitle={CVPR},
  year={2018}
}
            

RSA

Recurrent Scale Approximation for Object Detection in CNN

Yu Liu, Hongyang Li , Junjie Yan, Fangyin Wei, Xiaogang Wang, Xiaoou Tang
International Conference of Computer Vision (ICCV), 2017  
paper / code / bibtex
@InProceedings{liu2018rsa,
  title={Recurrent Scale Approximation for Object Detection in {CNN}},
  author={Yu Liu and
          Hongyang Li and
          Junjie Yan and
          Fangyin Wei and
          Xiaogang Wang and
          Xiaoou Tang},
  booktitle={ICCV},
  year={2017}
}
            



Professional Services



Teaching


Teaching Assistant

Princeton University COS 526: Neural Rendering, Spring 2023

Princeton University COS 302: Mathematics for Numerical Computing and Machine Learning, Fall 2020

Princeton University COS 302: Mathematics for Numerical Computing and Machine Learning, Spring 2020

Princeton University COS 429: Computer Vision, Fall 2019

Web design stolen from Jon Barron